A generalized Fannes' inequality 



S. Furuichi^* K.Yanagi^^and K.Kuriyama^^ 
^Department of Computer Science and System Analysis, College of Humanities and Sciences, Nihon University, 

3-25-40, Sakurajyousui, Setagaya-ku, Tokyo, 156-8550, Japan 
^Division of Applied Mathematical Science, Graduate School of Science and Engineering, 
Yamaguchi University, Tokiwadai 2-16-1, Ube City, 755-0811, Japan 



Abstract. We axiomatically characterize the Tsahis entropy of a finite quantum system. In 
addition, we derive a continuity property of Tsallis entropy. This gives a generalization of the 
Fannes' inequality. 
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1 Introduction with uniqueness theorem of TsalUs entropy 

Three or four decades ago, some extensions of Shannon entropy was studied by many researchers 
[1]. In statistical physics, the Tsahis entropy was defined in [10] by 

with one parameter q G as an extension of Shannon entropy Hi{X) = — ^xP{x) logp(x), for 
any probability distribution p{x) = p{X = x) of a given random variable X. Where g-entropy 
function is defined by r]q{x) = —x'^lugX = ^^Zg and the g-logarithmic function In^x = ^^^1^^ 
is defined for g > 0, g 7^ 1 and x > 0. 

The Tsallis entropy Hq{X) converges to the Shannon entropy — logp(x) as (7 — )• 1. 

See [5j for fundamental properties of the Tsallis entropy and the Tsallis relative entropy. In 
the previous paper [6j, we gave the uniqueness theorem for the Tsallis entropy for a classical 
system, introducing the generalized Faddeev's axiom. We briefly review the uniqueness theorem 
for Tsallis entropy below. 

The function Iq{xi, • • • , Xn) is assumed to be defined on n-tuple (xi, ■ ■ ■ , Xn) belonging to 



n 

A„ = I {pi, ■ ■ ■ ,Pn)\ ^Pi = '^,Pi > = 1,2, - • • ,n) 

I i=l ) 

and to take values in = [0, 00). Then we adopted the following generalized Faddeev's axiom. 
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Axiom 1.1 (Generalized Faddeev's axiom) 

(Fl) Continuity: The function fq{x) = Iq{x, 1 — x) with parameter q > is continuous on the 
closed interval [0, 1] and fq{xo) > for some xq G [0, 1]. 

(F2) Symmetry: For arbitrary permutation {a:^} G A„ of {x^} G A„, 

Iqi^l, ■ ■ ■ ,Xn) = Iq{Xi, ■ ■ ■ ,X^). (1) 

(F3) Generalized additivity: For Xn = y + z, y >0 and z > 0, 

Iq{xi, ■ ■ ■ ,Xn-l,y,z) = Iq{xi, ■ ■ ■ , Xn) + X^Ig (—,— ]. (2) 

\Xn Xn J 

Theorem 1.2 ([6j) The conditions (Fl), (F2) and (F3) uniquely give the form of the function 
Iq : An such that 

-^qi^li ' ' ' 1 ^n) — fJ-qFtqi^li ' ' ' i Xn)i (3) 

where fig is a positive constant that depends on the parameter q > 0. 

If we further impose the normahzed condition on Theorem 11.2^ it determines the entropy of 
type f3 (the structural a-entropy), (see p. 189 on [1]). 

Definition 1.3 For a density operator p on a finite dimensional Hilbert space H, the Tsallis 
entropy is defined by 

S^(p) ^ = Tr[riq{p)l 

with a nonnegative real number q. 

Note that Tsallis entropy is a particular case of /-entropy [11] . See also [9] for a quasi-entropy 
which is a quantum version of /-divergence [3]. 

Let Tq be a mapping on the set 5(H) of all density operators to R"*". 

Axiom 1.4 We give the postulates which the Tsallis entropy should satisfy. 

(Tl) Continuity: For p G ^(H), Tq{p) is a continuous function with respect to the 1-norm 

(T2) Invariance: For unitary transformation U , Tq{U*pU) = Tq{p). 

(T3) Generalized mixing condition: For p = ® XkPk on H = © H^, where Xk > 0, V,^, Afc = 

k=l k=l 

l,Pk G S(H.k), we have the additivity: 

n 

Tq{p) = KTqiPk) + TqiXi,- ■ ■ , Xn) , 

k=l 

where (Ai, • • • , A„) represents the diagonal matrix {Xk6kj)k,j=i,-,n- 
Theorem 1.5 IfTq satisfies Axiom \T^ then Tq is uniquely given by the following form 

Tq{p) = PqSqip), 

with a positive constant number pq depending on parameter q > 0. 
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Proof: Although the proof is quite similar to that of Theorem 2.1 in [8j, we give it for readers' 
convenience. From (T2) and (T3), we have 

Tg{Xi, A2) = A?T,(1) + XlTgil) + T,(Ai, A2), 

which implies Tq(l) = 0. Moreover, by (T2) and (T3), when 7^ 1, we have 



Tq{pi,--- ,Pn-l,XPn,{l- X)Pn) = P^Tg (A, 1 - A) + (1 - p„)^ Tg 

+ Tq{pn,l-Pn) 

and 



Pi Pn-l 



l-Pn l-Pn 



Tq {pi, ■ ■ ■ ,Pn~l,Pn) = P^Tq (!) + (1 - Pnf Tq ( , • • • , ^ | + Tq 1 - Pn) ■ 

\ -L Pn J- Pn / 

From these equations, we have 

Tq {pi,-- ■ ,Pn-l,XPn, (1 " A)p„) = Tq (pi,- • • ,Pn-l,Pn) + Pn^q (A, 1 - A) (4) 

If we set Xpn = y and (1 — A)^^ = z in Eq.([3]), then for p„ = y + z 7^ we have 

Tq {Pl, ■ ■ ■ ,Pn-l,y,z) = Tq (pi, • • • + P^Tq (—,— ). (5) 

\Pn Pn) 

Then for any x, y, z G R such that 0<x,y<l, 0<z<l and x + y + z = 1, we have 

y z 



Tg{x,y,z) = Tq{x,y + z) + {y + zfTq 
= Tq{y,x + z) + {x + zyTq 



y+z y+z 

X z 



X + Z X + z 



If we set tq{x) = Tq{x, 1 — x), then we have 



tq{x) + (1 - x)Hq { ) = tq{y) + (1 - y)% ' 



l-xj ' " \\-y 

Taking x = and some y > 0, we have Tg(0, 1) = tg(0) = for (7 7^ 0. Again setting A = in 
Eq.Q and using (T2), we have the reducing condition 

Tq(j)\, ■ ■ ■ ,Pn,0) = Tq{pi, ■ ■ ■ 

Thus Tq satisfies all conditions of the generalized Faddeev's axiom (Fl), (F2) and (F3). Therefore 
we can apply Theorem 11.21 so that we obtain Tq(Ai, • • • , A„) = fiqHq{Xi, ■ ■ ■ , A„). Thus we have 
Tq{p) = fiqSq{p), for density operator p. ■ 

Remark 1.6 For the special case q = in the above theorem, we need the reducing condition 
as an additional axiom. 
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2 A continuity of Tsallis entropy 

We give a continuity property of the Tsallis entropy Sq{p). To do so, we state a few lemmas. 
Lemma 2.1 For a density operator p on the finite dimensional Hilbert space H, we have 

Sq{p) < lUqd, 

where d = dim H < oo . 

Proof: Since we have In^ z < z — 1 for g > and z > 0, we have — ^ > x — y for x > 0, 
y > 0, g > and q 1, Therefore the Tsallis relative entropy [5]: 

Dg{p\a) = ^— ^ 

for two commuting density operators p and c, q > and g 7^ 1, is nonnegative. Then we have 
< Dq^pl^I) = —d'^~^ (Sqip) — Ing d). Thus we have the present lemma. ■ 

Lemma 2.2 If f is a concave function and /(O) = /(I) = 0, then we have 

+ <max{/(s),/(l-s)} 

for any s € [0, 1/2] and t € [0, 1] satisfying < s + t < 1. 

Proof. 

(1) Consider the function r{t) = f{s) — f{t + s) + f{t). Then r'{t) > since /' is a monotone 
decreasing function. Thus we have r{t) > by r(0) = 0. Therefore f{t + s) — f{t) < f{s). 

(2) Consider the function of l{t) = f{t + s) - f{t) + /(I - s). Then l'{t) < 0. Thus we have 
l{t) > by /(I -s) = 0. Therefore -/(I - s) < f{t + s) - f{t). 

Thus we have the present lemma. ■ 

Lemma 2.3 For any real number u,v € [0,1] and q G [0,2], if\u — v\ < ^, then \r]q{u) — riq{v)\ < 
r]q{\u-v\). 

Proof. Since r]q is a concave function with 7?q(0) = r]q{l) = 0, we have 

\Vq{t + s)- Vq{t)\ < max{r/g(s), ?7g(l - s)} 

for s € [0, 1/2] and t € [0, 1] satisfying 0<t + s<l, by Lemma |2.2[ Here we set 

hq{s) = r]q{s)-r]q{l-s), SG [0,1/2], q£[0,2]. 

Then we have hq{0) = hq{l/2) = and h'^{s) < for s G [0, 1/2]. Therefore we have hq{s) > 0, 
which implies 

max {r]q{s),riq{l - s)} = r}q{s). 
Thus we have the present lemma by letting u = t + s and v = t. ■ 

Theorem 2.4 For two density operators pi and p2 on the finite dimensional Hilbert space H 
with dimH = d and q G [0, 2], if \\pi — P2II1 < q^^^^~'^\ then 

\Sq{pl) -Sq{p2)\ < 11/91 - ^2 1 1 ? lUg d + r/g ( || pi - p2\\i)- 

Where we denote \\A\\-^ = Tr[(^*^)^/^] for a bounded linear operator A. 



proof: Let A^^^ > Ag^^ > ■ ■ ■ > A^^^ and A^^'' > Ag^^ > • • • > A^^^ be eigenvalues of two density 
operators pi and p2, respectively. (The degenerate eigenvalues are repeated according to their 
multiplicity.) We set e = Yl'j=i ^^'^ = ~ '^j^^l- Then we have 

ej<e<\\pi-p2h<q^^^'"'^ <l/2 
by Lemma 1.7 of [8]. Applying Lemma 12.31 we have 

d d 

By the formula Ing(xy) = In^ x + x^^"? In^ y, we have 
d d 




< eHnqd + rjqie). 

In the above inequality, Lemma [27T] was used for p = (ei/e, ■ ■ ■ , e^/e). Therefore we have 

\Sq{pi)-SM)\<^'^^<id + 7]q{e). 

Now r]q(x) is a monotone increase function on x € [0, g^^^^^'^-*]. In addition, x"^ is a monotone 
increasing function for q G [0,2]. Thus we have the present theorem. ■ 
By taking the limit as g — > 1, we have the following Fannes' inequality (see pp.512 of [7], 
also mm [8]) as a cororally, since limg^i = i. 

Corollary 2.5 For two density operators pi and p2 on the finite dimensional Hilbert space H 
with dimH = d < oo, if \\pi — P2\\i < ^, then 

\Si{pi) -51(^2)1 < IIpi -P2|liln(i + 7?i(i|pi -P2II1), 

where Si represents the von Neumann entropy Si{p) = Tr[rii{p)] and ??i(x) = — xlnx. 
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